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Abstract 

NASA Ames Research Center has a diverse pro- 
gram in planning and scheduling. This paper high- 
lights some of our research projects as well as some 
of our applications. Topics addressed include ma- 
chine learning techniques, action representations 
and constraint-based scheduling systems. The ap- 
plications discussed are planetary rovers, Hubble 
Space Telescope scheduling, and Pioneer Venus or- 
bit scheduling. 


1 Introduction 

NASA Ames Research Center’s Artificial Intelli- 
gence Research Branch, led by Dr. Peter PVied- 
land, has a diverse research program in planning 
and scheduling. Our work ranges from state-of-art 
fundamental research to applications of both new 
and existing technology. This paper is intended to 
summarize and highlight some of these activities. 

The research issues we will highlight include: 
machine learning and planning, planning represen- 
tations, non-symbolic representations, constraint- 
based scheduling, and the representation of proce- 
dural knowledge. 

The applications we will present include Hubble 
Space Telescope scheduling, Mars Rover planning 
and scheduling, and Pioneer Venus orbit schedul- 
ing. 


2 Planning and Scheduling 

It is important to clarify the terms “planning" and 
“scheduling* before we proceed. An agent plana 
by finding actions that will take it from its current 
state to another desired state. Classically, this is 
a goal directed search through a space of possible 
partial plans. Scheduling , on the other hand, refers 
to an agent placing explicit times or orderings on 
a set of intended actions. This is usually a search 
through a space of possible timelines. In short, 
we call the process of finding actions that achieve 
goals planning and we call the placement of times 
on those actions scheduling . 

3 Research 

Our research program is a mix of internal research, 
university grants, and commercial contracts. Here 
we will present a representative subset of the 
program conducted at Ames, SRI, Stanford, and 
Carnegie- Mellon. 

3.1 Learning in Planning 

One of our group’s areas of focus is machine learn- 
ing and we are particularly interested in its appli- 
cation to planning and scheduling. We are explor- 
ing ways to improve search performance through 
the application of explanation-based learning tech- 
niques [Mit87,DeJ87]. The main idea behind this 
work is that a system can improve its performance 
by analyzing the solutions to problems it has previ- 
ously encountered. As a result of this analysis, the 
system can remember the good decisions it made 
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as well as the poor ones. Ideally, we would like 
the system to generalize from this analysis so that 
the knowledge gained from its retrospection will 
be useful in cases that are not only identical to 
the ones it encountered, but also those that are 
close enough so that the previous experience would 
prove relevant and helpful. 

Dr. Steven Minton, of Carnegie- Mellon Uni- 
versity, performed a thorough analysis of a 
planning and learning system called PRODIGY 
[Min87,Min88]. PRODIGY is a STRIPS-like plan- 
ner that employs explanation- based learning to ac- 
quire search control knowledge. His results showed 
that learning will not necessarily improve the per- 
formance of a planning system and in many cases it 
can degrade performance. As a result, Dr. Minton 
explored various methods of monitoring the utility 
of learned knowledge in order to transform (or pos- 
sibly remove) learned knowledge to make the over- 
all system more useful. Dr. Minton has recently 
joined our laboratory and will continue exploring 
planning and learning issues. 

Another project within our laboratory is also ad- 
dressing the utility problem in planning systems 
that learn. Monte Zweben and collaborators at 
the MITRE Corporation are specifically address- 
ing the utility problem caused by the complexity 
of learned knowledge [Zwe88b]. When a planning 
system needs to make a decision it must consider 
the generalised information that it has learned. 
This pattern-matching overhead can overwhelm 
the system to the point where learned knowledge 
no longer aids efficiency. Using PRODIGY as a 
model, Mr. Zweben and his colleagues are de- 
veloping a system that employs explanation-based 
learning (EBL) to acquire search knowledge, but 
relaxes some of the constraints usually associated 
with EBL techniques. Specifically, EBL general- 
izes from a single instance and guarantees the cor- 
rectness of the learned knowledge. As a result, 
the learned information tends to be quite complex. 
This project’s main extension to the PRODIGY 
model is the approximation of learned knowledge 
in the interest of lowering the expense of the rel- 
evancy check. As a result, this approximation of 
learned knowledge could be incorrect and must be 
monitored. If the learned knowledge is approxi- 
mated erroneously and misleads the planner fre- 
quently, then the approximations must be refined. 
The goal of this project is to determine the approx- 
imation and refinement strategies that will result 


in an efficient and effective collection of knowledge 
learned by an explanation-based component. 


3.2 Planning Representations 

Dr. Mark Drummond, of our group, takes a 
Net Theory approach to the problem of planning, 
scheduling and control [Dru85,Dru87]. His ap- 
proach has a number of interesting features and ad- 
vantages. Similar to Amy Lansky’s [Lan87] work, 
it views a plan as a set of constraints over a pre- 
specified set of actions. Unlike Lansky’s GEM 
model, however, the Net Theory approach allows 
one to distinguish clearly between orderings re- 
quired by causality, and those that are simply con- 
venient, given the agent’s goals. The Net The- 
ory approach also begins to make clear the true 
role of least commitment planning , where order- 
ings on actions are postponed until an ordering 
decision must be made. Current plan represen- 
tations frequently over-commit to specific order- 
ings. This over-commitment is critical when deal- 
ing with complicated scheduling problems, since 
many orderings and conditions cannot be deter- 
mined until a schedule is actually being carried 
out. The Net Theory approach currently being 
explored by Dr. Drummond allows complete post- 
ponement of ordering decisions until all environ- 
mentally determined information is available. This 
permits a new view on the role of an agent’s syn- 
thetic temporal data structure. These data struc- 
tures can now be viewed as plans, schedules, or 
control programs, depending on the phase of over- 
all system operation. This work does not view 
planning and scheduling as a one-time process, but 
rather, includes an explicit control phase where 
plans/schedules are incrementally modified to suit 
execution needs. 

Dr. Drummond is also exploring a number of 
other issues in his planning research including: 
the tradeoff of reactive and predictive schedul- 
ing, the role of means-ends analysis in planning, 
the integration of planning and scheduling mech- 
anisms, the representation and derivation of con- 
ditional and iterative plans, the role of constraint- 
satisfaction in the planning process, and the use 
of domain constraints to control planning search 
[Dru88]. 
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3.3 Control Without Symbols 

The work of Dr. Stan Rosenchein, formerly of SRI 
International and now of Teleos Research, takes 
the perspective that expensive symbolic processing 
at run time can be avoided by compiling symbolic 
representations into circuitry guaranteed to act in 
bounded time. Dr. Rosenchein and his colleague 
Leslie Kaelbling have developed a set of tools that 
enables one to design a robotic controller in a high- 
level language, which then gets compiled into ef- 
ficient circuitry that can be simulated or manu- 
factured in hardware [Kae88,Ros86]. The funda- 
mental idea behind this work is that much of the 
expensive search (like pattern matching) employed 
by symbolic reasoners can be accomplished at com- 
pile time, allowing the robot to quickly process its 
sensory information and react appropriately. One 
of their tools, Gapps [Kae88], takes a goal expres- 
sion and rules in a goal decomposition language 
and outputs circuitry that will enable a system to 
take action given a goal and its current state. Their 
tool REX allows one to specify behavior that takes 
sensory input and the system’s current state and 
updates the current state to reflect what has oc- 
curred in the system’s environment. REX allows 
one to specify the circuitry in a language more ab- 
stract than circuits, but less abstract than that 
of a programming language. They are currently 
designing a system called RULER which will al- 
low one to design the state update circuitry in a 
logical language resembling PROLOG. Ultimately, 
this language will be compiled into REX specifica- 
tions. 

This work is distinguished in that the REX lan- 
guage has been specifically designed to support 
analysis of any particular REX program to prove 
its correctness. Further, this work is currently used 
to control Flakey, the SRI mobile robot. We view 
this work as a realistic first step towards the pro- 
duction of efficient robotic control tools. It begins 
to show how a designer can allocate computational 
resources at different phases of the design and de- 
ployment process. 

3.4 Constraint-based Scheduling 

As previously mentioned, scheduling is the process 
of placing a pre-specified set of actions on a time- 
line ensuring that the schedule’s constraints are 
maintained. One of our projects, led by Monte 
Zweben, addresses the formulation and resolu- 


tion of complex scheduling and resource allocation 
problems using constraints to represent schedul- 
ing knowledge and preferences [Zwe88a]. Con- 
straints are declarative representations of relation- 
ships that abstract away control flow. They allow 
one to specify the relationships between the prob- 
lem’s variables in a system and enable the sys- 
tem to automatically determine the computation 
path from known variables to the unknown [Sta77]. 
These representations can be used for lookahead in 
a search process. Lookahead or constraint propa- 
gation results in less backtracking (i.e., fewer fu- 
tile search paths) because commitments to various 
choices in the system are made only if they are 
compatible with the choices remaining in the sys- 
tem [Har80,Ste80]. However, lookahead can result 
in unnecessary constraint propagation. To circum- 
vent this problem, we employ a technique called 
delayed evaluation [Fil84]. A system employing de- 
layed evaluation does not completely evaluate its 
data structures until they are accessed. We use 
the data structure streams [Abe85] which are lists 
that delay the evaluation of their tails (i.e., all the 
elements of the list except the first element). The 
use of streams is advantageous for two main rea- 
sons: l) their delayed evaluation circumvents un- 
necessary constraint propagation; 2) their delayed 
evaluation is transparent to knowledge engineers 
because stream operations are quite similar to list 
operations and our model of constraint-satisfaction 
is based upon list operations. 

3.5 Procedural Knowledge 

Dr. Michael Georgeff of SRI International has de- 
veloped a system called PRS - Procedural Reason- 
ing System - that enables one to represent and use 
complex procedural knowledge [Geo86]. PRS takes 
a set of procedures and executes them in a goal- 
directed manner. It uses a declarative represen- 
tation of procedures that extends the expressive- 
ness of previous action representations. Actions in 
PRS can exhibit iteration and recursion and also 
can employ run-time conditional branching. Thus, 
decisions as to what action to perform next can be 
dependent upon the runtime environment. PRS 
procedures can also be interrupted by other proce- 
dures, thereby allowing emergency recognition and 
exception handling. The ability to change its focus 
of attention quickly and to act conditionally makes 
PRS a highly reactive system. 
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PRS also has interesting theoretical aspects in 
that it meets much of the rational agency crite- 
ria proposed in the recent philosophical literature. 
Because PRS behaves like a rational agent there 
is potential for the development of interesting ex- 
planation components. PRS has been exercised 
in a very complex and interesting domain: mal- 
function handling for the reaction control system 
of the Space Shuttle. NASA diagnostic manuals 
were encoded in PRS resulting in an extensible set 
of semi-autonomous procedures. 

4 Applications 

The Ames A I Research Lab performs state-of-the- 
art research, but does so in the context of real- 
world applications. This allows us to both verify 
that our methods scale-up to real problems and 
focus our research towards topics of interest to 
NASA. In addition to framing our research within 
NASA problems, we also demonstrate the util- 
ity of known AI techniques with engineering ap- 
plications. Don Rosenthal is the director of our 
applications work. His applications projects in- 
clude Pioneer Venus satellite scheduling and Hub- 
ble Space Telescope scheduling. In fiscal year 1989, 
Mr. Rosenthal will explore planetary rover appli- 
cations. 

4.1 Pioneer Venus 

This project, now completed, showed the util- 
ity of rule-based systems for operational software 
[Ros88]. We developed a heuristic ground- based 
scheduler for science operations (e.g., instrument 
configurations, data storage and playback, teleme- 
try, etc.) onboard the Pioneer Venus satellite. This 
software is currently performing a task in minutes 
which formerly took people hours. Further, the re- 
sulting schedules are as effective as the man-made 
ones but contain fewer flaws. The satellite’s op- 
erations are currently scheduled with this expert 
system. This scheduler is the first expert system 
installed in day to day use within a NASA mission 
operations environment. 

4.2 Hubble Space Telescope (HST) 
Scheduling 

Thousands of proposed observations for HST must 
be processed by the Space Telescope Science In- 


stitute (STScI), on the Johns Hopkins University 
campus in Baltimore, to construct schedules for 
the science operations of the orbiting optical obser- 
vatory. Current software is not flexible or exten- 
sible enough to meet the operational demands ex- 
pected on the system and we are helping to provide 
knowledge-based solutions to this problem [Mil87]. 

The HST projects we support take a constraint- 
based approach to scheduling. Dr. Stephen Smith, 
of Carnegie- Mellon University, is applying research 
in factory scheduling [Fox83,Smi86] to the HST 
problem. This approach is well suited for over- 
constrained problems where a solution requires the 
relaxation of constraints. 

Another project, at the STScI, is applying state- 
of-the-art constraint satisfaction techniques to the 
HST scheduling problem. Their goal is to produce 
a flexible and extensible scheduler that can dynam- 
ically react to anomalies and re-schedule accord- 
ingly. This work has resulted in a program called 
SPIKE, which uses piecewise constant functions to 
quantitatively represent the degree of constraint 
violation. Using these functions, SPIKE can ef- 
ficiently combine constraints as well as judge the 
options it must choose. 

4.3 Planetary Rovers 

In the coming year we will begin performing ex- 
tensive research into the planetary rover problem 
while concentrating on the science planning and 
scheduling issues. Using the Mars Rover domain 
as a model, we are interested in rovers that can 
autonomously plan and execute an appropriate 
set of scientific analyses for many different science 
goals. Further, we will explore techniques that dy- 
namically discover interesting science opportuni- 
ties, and attempt to replan the rover’s actions to 
accomodate these new goals. 

Additionally, we will address the integration of 
navigation planning and science planning which 
will require research in systems that negotiate for 
resources and time. 

We will also explore machine learning techniques 
that can improve the overall rover system. First, 
we will explore techniques that improve a system’s 
search performance. Second, we will address model 
refinement for rovers that begin with a rough and 
incomplete model of their environment. These 
techniques review a system’s actions and remem- 
bers when they succeed and when they fail. They 
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also find discrepencies between a system’s expecta- 
tions and its observations and uses these discrepen- 
cies to refine the system’s models. 

5 Summary 

This paper is intended to selectively introduce our 
research and to point out references to technical 
papers. Some of the areas currently addressed by 
our group but not discussed here are: 1) planning 
with incomplete models [Car87b,Car87a], 2) the 
use of truth-maintenance in planning [Mor86], and 
3) communicating, cooperating agents [Nil87]. In 
the coming year, we plan to expand our efforts in 
multi-agent planning and constraint satisfaction. 
The overall goal of the program is to develop the 
technology for large-scale automation of space mis- 
sions. 
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